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DECOMPOSITION OF THIRD-ORDER TENSORS PART II: 
UNIQUENESS OF THE OVERALL DECOMPOSITION * 

IGNAT DOMANOVtt AND LIEVEN DE LATHAUWERtt 



Abstract. Canonical Polyadic (also known as Candecomp/Parafac) Decomposition (CPD) of 
a higher-order tensor is decomposition in a minimal number of rank-1 tensors. In Part I, we gave 
an overview of existing results concerning uniqueness and presented new, relaxed, conditions that 
guarantee uniqueness of one factor matrix. In Part II we use these results for establishing overall CPD 
uniqueness in cases where none of the factor matrices has full column rank. We obtain uniqueness 
conditions involving Khatri-Rao products of compound matrices and Kruskal-type conditions. We 
consider both deterministic and generic uniqueness. We also discuss uniqueness of INDSCAL and 
other constrained polyadic decompositions. 
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1. Introduction. 

1.1. Problem statement. Throughout the paper F denotes the field of real 
or complex numbers; (•)*, {■)'^ , and (•)^ denote conjugate, transpose, and conjugate 
transpose, respectively; ta, range(A), and ker(A) denote the rank, the range, and 
the null space of a matrix A, respectively; Diag(d) denotes a square diagonal matrix 
with the elements of a vector d on the main diagonal; spanjfi, . . . , f^} denotes the 
linear span of the vectors fi , . . . , ; e^ denotes the r-th vector of the canonical basis 
of F^; denotes the binomial coefficient, = -^fj^^kji', Omxm 0^, and I„ are the 
zero m X n matrix, the zero m x 1 vector, and the n x n identity matrix, respectively. 

We have the following basic definitions. A third-order tensor T = {tijk) G F^^'^^^ 
is rank-1 if there exist three nonzero vectors a £ F^, b £ F'' and c G such that 
7~ = a o b o c, in which "o" denotes the outer product. That is, tijk = cabjCk for all 
values of the indices. 

A Polyadic Decomposition (PD) of a third-order tensor 7" G jf^x-'x^ expresses T 
as a sum of rank-1 terms: 

R 

T = a^ O br O Cr, (1-1) 

r=l 

where a^ G F^, b^ £ F'', G F^ are nonzero vectors. 

We call the matrices A = [ai ... a^] £ F^^^, B = [bi ... b^] G F"'^^ 
and C = [ci ... c/j] G F^^^^ the first, second and third factor matrix of 7", 
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respectively. We also write as T = [A, B, C]/{. 

Definition 1.1. The rank of a tensor T G p^x-'x^ {g defined as the minimum 
number of rank-1 tensors in a PD of T and is denoted by r-j-. 

Definition 1.2. A Canonical Polyadic Decomposition (CPD) of a third-order 
tensor T expresses T as a minimal sum of rank-1 terms. 

Note that T = [A, B, C]^ is a CPD of T if and only if i? = rr- 

Let us reshape T into a matrix T G ^iJ'>^i^ ^s follows: the fc)-th entry of 
T corresponds to the {(i — 1) J + j, fc)-th entry of T. In particular, the rank-1 tensor 
a o b o c corresponds to the rank-1 matrix (a ® b)c-'", in which "(g)" denotes the 
Kronecker product. Thus, (jl.ip can be identified with 

R. 

T(i) := T = ^(a^ (g) hr)c^ = [ai (g) bi • • • a^ (g hR]C^ = (A B)C^, (1.2) 

in which "0" denotes the Khatri-Rao product or column-wise Kronecker product. 
Similarly, one can reshape a o b o c into any of the matrices 

(b0c)a^, (c0a)b^, (a0c)b^, (b0a)c^, (c b)a^ 

and obtain the factorizations 

t(2) = (B0C)A^, t(3) = (C A)B'^, t(4) = (A0C)B^ etc. (1.3) 

The matrices T*-^', T*-^', . . . are called the matrix representations or matrix unfoldings 
of the tensor T. 

It is clear that in (|l.ip - (|1.2p the rank-1 terms can be arbitrarily permuted and 
that vectors within the same rank-1 term can be arbitrarily scaled provided the overall 
rank-1 term remains the same. The CPD of a tensor is unique when it is only subject 
to these trivial indeterminacies. Formally, we have the following definition. 

Definition 1.3. Let T be a tensor of rank R. The CPD of T is essentially 
unique ifT= [A, B, C\r = [A, B, C\r implies that there exist an Rx R permutation 
matrix 11 and R X R nonsingular diagonal matrices Aa, Ab, and Ac such that 

A = AnAA, B = BnAB, C = CnAc, AaAbAc=Ik 

PDs can also be partially unique. That is, a factor matrix may be essentially unique 
without the overall PD being essentially unique. We will resort to the following 
definition. 

Definition 1.4. Let T be a tensor of rank R. The first (resp. second or third) 
factor matrix of T is essentially unique if T = [A, B, CJ/j = [A, B, CJ^ implies that 
there exist an Rx R permutation matrix 11 and an Rx R nonsingular diagonal matrix 
Aa (resp. Ab or Ac j such that 

A = AHAa {resp. B = BHAb or C = CHAc). 

For brevity, in the sequel we drop the term "essential" , both when it concerns the 
uniqueness of the overall CPD and when it concerns the uniqueness of one factor 
matrix. 

In this paper we present both deterministic and generic uniqueness results. Deter- 
ministic conditions concern one particular PD T = [A, B, C]j^. For generic uniqueness 
we resort to the following definitions. 

Definition 1.5. Let ^ be the Lebesgue measure on pii+J+K)i^'^ The CPD of an 
I X J X K tensor of rank R is generically unique if 

/i{(A, B, C) : the CPD of the tensor [A, B, CJ^ is not unique } = 0. 
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Definition 1.6. Let fi be the Lebesgue measure on F'^"''"^"*'^)^. The first (resp. 
second or third) factor matrix of an I x J x K tensor of rank R is generically unique 
if 

//{(A, B,C) : the first (resp. second or third) factor matrix 
of the tensor [A, B, Cja is not unique} = 0. 



Let the matrices A e F^^-", B e F"'^^ and C G F^^^ be randomly sampled 
from a continuous distribution. Generic uniqueness then means uniqueness that holds 
with probability one. 

1.2. Literature overview. We refer to the overview papers [31[S1[T2] and the 

references therein for background, applications and algorithms for CPD. Here, we 
focus on results concerning uniqueness of the CPD. 

1.2.1. Deterministic conditions. We refer to [7, Subsection 1.2] for a detailed 
overview of deterministic conditions. Here we just recall three Kruskal theorems and 
new results from [7] that concern the uniqueness of one factor matrix. To present 
Kruskal's theorem we recall the definition of fc-rank. 

Definition 1.7. The k-rank of a matrix A is the largest number k^ such that 
every subset of k^ columns of the matrix A is linearly independent. 

Kruskal's theorem states the following. 

Theorem 1.8. |77[ Theorem 4a, p. 123] Let T = [A,B,C]i^ and let 

fcA + fce + fcc >2i? + 2. (1.4) 

Then r-j- — R and the CPD of T = [A, B, CJj^ is unique. 

Kruskal also obtained the following more general results which are less known. 

Theorem 1.9. [I^ Theorem 4b, p. 123] (see also Corollary \1.29\ below) Let 
T = [A,B,C]i^ and let 

min(fcA, fee) + re > i? + 2, 

min(fcA, fee) + rc > i? + 2, 

''A + ?'B + "Tc > 2i? + 2 + min(rA - ^a, t'b - ^b), 
T-A + '"B + > 2i? + 2 + min(rA - ^a, - fee)- 

Then rj- — R and the CPD of T — [A, B, CJj^ is unique. 

Let the matrices A and B have R columns. Let A be any set of columns of A, 
let B be the corresponding set of columns of B, and define 

Hab{(>) ■= min [r^+r^-S] for 6 = 1,2,...,R. 

card{A.) — S 

We will say that condition (Hm) holds for the matrices A and B if 

HAniS) > mm{S, m) for 5 = 1, 2, . . . , i?. (Hm) 

The following Theorem is the strongest result about uniqueness from jl4j . 

Theorem 1.10. {T^} Theorem 4e, p. 125](see also Corollary \1.27\ below) Let 
T = [A, B, C]r and let me := -R — + 2, mc := i? — rc + 2. Assume that 
(i) (Hi) holds for B and C; 
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(ii) (Hnig) holds for C and A; 

(iii) (Hnif^) holds for A and B. 

Then r-j- — R and the CPD of T ~ [A, B, C\r is unique. 

For the formulation of other resuhs we reeah the definition of compound matrix. 

Definition 1.11. [71 Definition 2.1 and Example 2.2] The k-th compound 
matrix of I x R matrix A ( denoted by Ck (A) ) is the Cf x matrix containing the 
determinants of all k x k submatrices of A, arranged with the submatrix index sets in 
lexicographic order. 

With a vector d = [di ... da] we associate the vector 

d" := [di • • ■ di ■ ■ ■ d„i^idm+i ... • • • di?] ^ £ F*^" , (1.5) 

whose entries are all products dt-^ ■ ■ ■ d,;^ with 1 < ii < • • • < i,„ < i?. Let us 
define conditions (Km), (Cm), (Um) and (Wm), which depend on matrices A G F^^''^, 
B e c £ F^^^ and an integer parameter m: 

rA + ku > R + m, ( ru + kA > R + m, ^ (k \ 

kA > rn \ k-Q > m i V / 

Cm (A) C„i(B) has full column rank; (Cm) 
'(C„(A)0Cm(B))d™ = O, g,„^ 

deF« ' ^ ' 



(Cm(A)0Cm(B))d™ = 0, 
d e range(C-^) 



(Wm) 



In the sequel, we will for instance say that "condition (Um) holds for the matrices X 
and Y" if condition (Um) holds for the matrices A and B replaced by the matrices 
X and Y, respectively. We will simply write (Um) (resp. (Km),(Hm),(Cm) or (Wm)) 
when no confusion is possible. 

It is known that conditions (K2), (C2), (U2) guarantee uniqueness of the CPD with 
full column rank in the third mode (see Proposition 11.15] below) . and that condition 
(Km) guarantees the uniqueness of the third factor matrix [5], [71 Theorem 1.12]. 

In the following Proposition we gather, for later reference, properties of conditions 
(Km), (Cm), (Um) and (Wm) that were established in [H §2-§3]. The proofs follow 
from properties of compound matrices [3 Subsection 2.1]. 

Proposition 1.12. 

(1) //(Km) holds, then (Cm) and (Hm) hold Q Lemmas 3.8, 3.9]; 

(2) i/(Cm) or (Hm) holds, then (Um) holds Lemmas 3.1, 3.10]; 

(3) if (Um) holds, then (Wm) holds Lemma 3.3]; 

(4) if (Km) holds, then (Kk) holds for k <m f?, Lemma 3.4]; 

(5) if (Hm) holds, then (Hk) holds for k < m /7, Lemma 3.5]; 

(6) if (Cm) holds, then (Ck) holds for k < m /7, Lemma 3.6]; 

(7) if (Um) holds, then (Uk) holds for k < m /7;, Lemma 3.7]; 

(8) if (Wm) holds and min(fcA,fcB) ^ rn — 1, then (Wk) holds for k < m ^ 
Lemma 3.12 ]; 

(9) if (Um) holds, then min(A;A, k-o) > m /7, Lemma 2.8 ]. 
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(1.6) 



and 



if min(fcA,fcB) > m — 1, then (Wm) (Wm-i) 



(W2) (Wi). (1.7) 



Scheme (jl.6l) also remains valid after replacing conditions (Cm),. . . ,(Ci) and equiva- 
lence (Ci) <^ (Ui) by conditions (Hm),. . . ,(Hi) and implication (Hi) => (Ui), respec- 
tively. One can easily construct examples where (Cm) holds but (Hm) does not hold. 
We do not know examples where (Hm) is more relaxed than (Cm). 

Deterministic results concerning the uniqueness of one particular factor matrix 
were presented in [71 §4]. We first have the following proposition. 

Proposition 1.13. Proposition 4.9] Let A e F^^^, B e C e F^'^'^-^, 

and let T = [A, B, C\r. Assume that 

(i) fee > 1; 

(ii) m = i?-rc+2< min(/, J); 

(iii) A B has full column rank; 

(iv) the triplet of matrices (A, B, C) satisfies conditions (Wm), . . . , (Wi). 
Then r-j- ~ R and the third factor matrix of T is unique. 

Combining Propositions II . 12l and [TTT51 we obtained the following result. 

Proposition 1.14. /7, Proposition 4-3, Corollaries 4-4 4-^] Let A, B, C, 
and T he as in Provosition ll. l3[ Assume that fee > 1 o,nd m — mc := i? — re + 2. 
Then 



trivial 



(Cm) 

(Km) (Ui, 



(Ci) 

min(A:A, k^) > m ~ 1, 

(Wm) 



(Hm) 



(1.8) 




. , (Wm) 



rr = i?, 

the third factor matrix of T is unique. 



Note that for rc = R, we have m — 2 and (U2) is equivalent to (W2). Moreover, 
in this case (U2) is necessary for uniqueness. We obtain the following counterpart of 
Proposition 11.141 

Proposition 1.15. Q fTOlfT^ Let A, B, C, and T be as in Promsition \1.13\. 
Assume that rc, = R. Then 



(C2) 

(El (K2) (U2) 

(H2) 



rr = R, 

the CPD of 7" is unique. 



(1.9) 
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1.2.2. Generic conditions. Let the matrices A e F-^^^, B e ]pJ^R and C e 

■pKxR j-jg randomly sampled from a continuous distribution. It can be easily checked 
that the equations 

= rA = min(/, i?), fee = ?'B = min( J, R), kc = rc = min(iir, R) 

hold generically. Thus, by (|1.4p . the CPD of an / x J x tensor of rank R is 
generically unique if 

min(/, R) + mm( J, R) + mm{K, R) > 2R. + 2. (1.10) 

The generic uniqueness of one factor matrix has not yet been studied as such. It can 
be easily seen that in (|1.8I) the generic version of (Km) for m = R — K + 2 is also 
given by pTTU)) . 

Let us additionally assume that K > R. Under this assumption, (ll.lOp reduces 

to 

min(/, R) + min( J, R)> R + 2. 

The generic version of condition (C2) was given in [?1[TH] . It was indicated that the 
CjCj X matrix U = C2(A) 0C2(B) generically has full column rank whenever the 
number of columns of U does not exceed the number of rows. By Proposition 11.15] 
the CPD of an / X J X i^T tensor of rank R is then generically unique if 

K>R and I{I -I) J{J -l)/A = C]C^j>Cl = R{R- l)/2. (1.11) 

The four following results have been obtained in algebraic geometry. 

Theorem 1.16. fH Corollary 3.7] Let 3 < I < J < K , K - 1 < {I - 1){J - 1), 
and let K he odd. Then the CPD of an I x J x K tensor of rank R is generically 
unique if R < UK /{I + J + K-2)-K. 

Theorem 1.17. /£, Theorem 1.1] Let L < J < K . Let a, /3 be maximal such 
that 2" < / and 2^ < J. Then the CPD of an I x J x K tensor of rank R is generically 
unique if R < 2"+'^-^. 

Theorem 1.18. Proposition 5.2], fM Theorem 2.7] Let R < {I -1){J -I) < 
K . Then the CPD of an I x J x K tensor of rank R is generically unique. 

Theorem 1.19. Theorem 1.2] The CPD of an L x I x L tensor of rank R is 
generically unique if R < k{I), where k{I) is given in Table [7771 

Table 1.1 

Upper bound k(I) on R under which generic uniqueness of the CPD of a I X I X I tensor is 
guaranteed by Theorem \1.19\ 



I 


2 3 4 5 


6 


7 8 


9 


10 


k(I) 


2 3 5 9 


13 


18 22 


27 


32 



Finally, for a number of specific cases of dimensions and rank, generic uniqueness 
results have been obtained in [TO] . 

1.3. Results and organization. In this paper we use the conditions in (II. Sp 
to establish CPD uniqueness in cases where rc < R- 

In [J2]we assume that a tensor admits two PDs that have one or two factor matrices 
in common. We establish conditions under which both decompositions are the same. 
We obtain the following results. 
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Proposition 1.20. LetT = [A, B, CJ/^ [A, B, CnAc]i?,, w/iere n is ok i?xi? 
permutation matrix and Ac is a nonsingular diagonal matrix. Let the matrices A, B 
and C satisfy the following condition 

max(min(fcA, — 1), min(fcA — 1, ^b)) + fee > -R + 1. (1-12) 

Then there exist nonsingular diagonal matrices Aa and Ab such that 

A = AHAa, B = BHAb, AaAbAc = Ir. 



Proposition 1.21. LetT ^ [A,B,C]i^ = [AIIaAa, B, CIIcAcli?,, where IIa 
and lie «re R x R permutation matrices and where Aa and Ac are nonsingular 
diagonal matrices. Let the matrices A, B and C satisfy at least one of the following 
conditions 

kc > 2 and max(min(fcA, ^b ~ 1), inin(fcA — 1, ^b)) + rc > R + I, _^ ^ 
/ca > 2 and max(min(fcB, fcc — 1), inin(fcB — 1, fee)) + rji^ > R + I. 

Then Ha = He and B = BHaA^^A^^ 

Note that in Propositions 11.201 and 11.211 we do not assume that R is minimaL 
Neither do we assume in Proposition 11.211 that IIa and He are the same. 

In SJ3] we obtain new results concerning the uniqueness of the overah CPD by 
combining (II. 8p with results from ^ 

Combining (|1.8p with Proposition 11.201 we prove the following statements. 

Proposition 1.22. Let T = [A,B, C]^ and mc i? - rc + 2. Assume that 

(i) condition (I1.12p holds; 

(ii) condition (Wm^^) holds for A, B, and C; 

(iii) A B has full column rank. (Ci) 
Then r-j- = R and the CPD of tensor T is unique. 

Corollary 1.23. Let T = [A,'B,C]b. andmc :=i?-rc+2. Assume that 

(i) condition ()1.12|) holds; 

(ii) condition (Um^) holds for A and B. 
Then r-j- = R and the CPD of tensor T is unique. 

Corollary 1.24. Let T = [A,B, CJ^, and mc ■= R- rc + 2. Assume that 

(i) condition (|1.12p holds; 

(ii) condition (Hmj-,) holds for A and B. 
Then r-y — R and the CPD of tensor T is unique. 

Corollary 1.25. Let T = [A,B, C];^ anrf toc := -R - ?'c + 2. Assume that 

(i) condition p.l2p holds; 

(ii) Cmc(A) 0Cmc(B) has full column rank. 
Then r-j- = R and the CPD of tensor T is unique. 

Note that Proposition 11.151 is a special case of the results in Proposition ll.22[ 
Corollaries II. 23fil. 251 and Kruskal's Theorem 11.81 In the former, one factor matrix is 
assumed to have full column rank (rc = i?) while in the latter this is not necessary 
(rc = R — mc + 2 with mc > 2). The condition on C is relaxed by tightening 
the conditions on A and B. For instance, Corollary 11.231 allows rc — R ~ mc + 2 
with m := mc > 2 by imposing ()1.12p and (Cm). From scheme (II. 6p we have 
that (Cm) implies (C2), and hence (Cm) is more restrictive than (C2). Scheme ()1.6p 
further shows that Corollary 11.231 is more general than Corollaries 11.241 and 11.251 In 
turn. Proposition 11.221 is more general than Corollary 11.231 Note that we did not 
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formulate a combination of implication (Km) ^ (Cm) (or (Hm)) from scheme (|1.8p 
with Proposition 11.201 Such a combination leads to a result that is equivalent to 
Corollary 11.291 below. 

Combining (|1.8p with Proposition II .211 wc prove the following results. 

Proposition 1.26. Let T ^ [A,B,C] ji and let 

niA ■■= R- rA + '2, niB ■■= R-rB + 2, mc :== i? - rc + 2. (1.14) 

Assume that at least two of the following conditions hold 

(i) condition (Um^) holds for B and C; 

(ii) condition (Umg) holds for C and A; 

(iii) condition (Um^-,) holds for A and B. 
Then r-j- = R and the CPD of tensor T is unique. 

Corollary 1.27. LetT — [A, B,C]ij and consider mx, rn-Q, and mc defined 
in (jl.l4p . Assume that at least two of the following conditions hold 

(i) condition (Hm^) holds for B and C; 

(ii) condition (Hm^) holds for C and A; 

(iii) condition (Hm^-,) holds for A and B. 
Then r-j- — R and the CPD of tensor T is unique. 

Corollary 1.28. LetT = [A, B,C]fl and consider m a, rns, and mc defined 
in (|1.14p . Let at least two of the matrices 

C„,^(B)0C,„^(C), C„,3(C)0C„3(A), C,na{A)QC,na{B) (1.15) 

have full column rank. Then r-j- = R and the CPD of tensor T is unique. 

Corollary 1.29. LetT =[A,B,C]ij and let {X,Y,Z) coincide with {A, B,C), 
(B,C,A), or (C,A,B). // 

( kx + r^+rz >2R + 2, 

\ min(rz + fcY,fcz +rY) > R + 2, ^ 

then r-y- = R and the CPD of tensor T is unique. 

Corollary 1.30. Let T — [A,B, C\r and let the following conditions hold 

' kx + ?-B +rc> 2i? + 2, 

< r-A + fcB+r-c > 2i? + 2, (1.17) 
jA + rji + kc > 2R + 2. 

Then r-j- — R and the CPD of tensor T is unique. 

Let us compare Kruskal's Theorems [QHTTOl with Corollaries [TMl [OTl [L29l 
and 11.301 Elementary algebra yields that Thcorcm ll.9l is equivalent to Corollarv ll.291 
From Corollarv ll.27l it follows that assumption (i) of Theorem II. 101 is redundant. We 
will demonstrate in Examples 13.21 and 13.31 that it is not possible to state in general 
which of the Corollaries 1 1 . 241 or 1 1 . 2 71 is more relaxed. Thus, Corollarv 11.241 (obtained 
by combining implication (Hm) (Um) from scheme (|1.8I) with Proposition ll.2ip is an 
(Hm)-type result on uniqueness that was not in [14]. Corollarv ll.30l is a special case of 
Corollarv ll.291 which is obviously more relaxed than Kruskal's well-known Theorem 
11.81 Finally we note that if condition (Hm) holds, then + + > 2R + 2. Thus, 
neither Kruskal's Theorems [TTMrTUl nor Coroharies [T^ [TTTI [T^ [OOl can be used 
for demonstrating the uniqueness of a PD [A, B, C\ii when + ^b + rc < 2R + 2. 
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We did not present a result based on a combination of (Wm)-type implications 
from scheme (|1.8I) with Proposition 11.211 because we do not have examples of cases 
where such conditions are more relaxed than those in Proposition II. 2b1 

In []4]we indicate how our results can be adapted in the case of PD symmetries. 

Well-known necessary conditions for the uniqueness of the CPD are [21, p. 2079, 
Theorem 2], [El p. 28], [HI p. 651] 

min(fcA,fcB,fcc) > 2, (1.18) 
A0B, B0C, C0A have fuh column rank. (1-19) 

Further, the following necessary condition was obtained in Theorem 2.3] 

(U2) holds for pairs (A,B), (B,C), and (C,A). (1.20) 

It follows from scheme (|1.6p that (|1.20|) is more restrictive than ()1.18|) and (|1.19p . 
Our most general condition concerning uniqueness of one factor matrix is given in 
Proposition 11.131 Note that in Proposition 11.131 condition (i) is more relaxed than 
(|1.18p and condition (iii) coincides with (I1.19p . One may wonder whether condition 
(iv) in Proposition 11.131 is necessary for the uniqueness of at least one factor matrix. 
In [jniwe show that this is not the case. We actually study an example in which CPD 
uniqueness can be established without (Wm) being satisfied. 

In fJ5]we study generic uniqueness of one factor matrix and generic CPD unique- 
ness. Our result on overall CPD uniqueness is the following. 

Proposition 1.31. The CPD of an I x J x K tensor of rank R is generically 
unique if there exist matrices Aq G F^^^, Bo G jp-'x-R^ ajid £ ^KxR ^^^/j ^/j^j^ 
least one of the following conditions holds: 

(i) Crnc (-A-o) Cmc (Bo) has full column rank, where mc = R — min(A', R) + 2; 

(ii) C„ia(Bo) C„iA(Co) has full column rank, where ttja = R — min(/, R) + 2; 

(iii) C„ib(Co) Cto3(Ao) has full column rank, where ttib — R ^ min(J, R) + 2. 
We give several examples that illustrate the uniqueness results in the generic case. 

2. Equality of PDs with common factor matrices. In this section we as- 
sume that a tensor admits two not necessarily canonical PDs that have one or two 
factor matrices in common. In the latter case, the two PDs may have the columns 
of the common factor matrices permuted differently. We establish conditions that 
guarantee that the two PDs are the same. 

2.1. One factor matrix in common. In this subsection we assume that two 
PDs have the factor matrix C in common. The result that we are concerned with, is 
Proposition ll.201 The proof is based on the following three lemmas. 

Lemma 2.1. For matrices A, A e F^'^^ and indices ri, . . . , r„ G {1, . . . , i?} 
define the subspaces Er^...rn ^^^^ Er-^,,,r„ o.s follows 

Tn '• ~~ span^l^a^^ , . . . , a^.^ } , i span^j^a^.^ , . . . , a^^^ } . 

Assume that kjs^ > 2 and that there exists m G {2, . . . , /ca} such that 

Erx...r„,_x C i?ri...r,„_i for all 1 < Ti < r2 < • • • < r,n-i < R- (2.1) 

Then there exists a nonsingular diagonal matrix A such that A ~ AA. 
Proof. For m — 2 we have 

spanjari} ~ Er^ C Er^ — spanjar^}, for all 1 < ri < i?, (2-2) 
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such that the Lemma trivially holds. For m > 3 we arrive at (|2.2p by downward 
induction on Z = m, m — 1, . . . , 3. Assuming that 

■Eri...n_i ^ ■E'ri...n_i for aU 1 < ri < r2 < • • • < n_i < R, (2.3) 
we show that 

Eri...ri_2 ^ Er^...ri_2 for aU 1 < ri < r2 < • • • < n_2 < ^■ 

Assume ri, r2, . . . , r/_2 fixed and let i,j G {1. . . . , R\ \ {ri, . . . , ri_2}, with i ^ j- 
Since I < m < k^, we have that d 

I = dim£;ri,...,ri_2,jj < dimspan{i?ri,...,n_2,j, 'E^ri,...,n_2 j} 

< dimspan{£:ri,...,r,_2,», ■E^ri,...,n_2 jl 

we have 

Eri,...,ri-2,i 7^ -^ri,...,r;_2 J ■ (2-4) 

Therefore, 

Eri,...,r,_2 ^ (-E'ri,...,r,_2,i n i?ri,...,r;_2 j) 

— \Eri,...,ri-2,i ^ Eri,....ri-2,j) ~ .....r; _2 ■ 

The induction follows. To conclude the proof, we note that A is nonsingular since 
/CA > 2. □ 

Lemma 2.2. Let C G F^^^ and consider m such that m < kc- Then for any 
set of distinct indices I — {ii, . . . , C {1, . . . , R} there exists a vector x G 

such that 

x'^Q = for iel and x^c, ^ for i e I" := {I, . . . , R} \ I. (2.5) 



Proof Let Ci G F^'^("-i) and Cjc G F^^(-«-"+i) contain the columns of 
C indexed by I and I'^, respectively, and let the columns of Cj G F^'^(^^™+^' 
form a basis for the orthogonal complement of range(Cx). The matrix {C^)^ Cio 
cannot have a zero column, otherwise the corresponding column of Cjc would be in 
range(Ci), which would be a contradiction with kc > m. We conclude that (j2.5p 
holds for X = (C^y)*, with y G F^~'"+^ generic. □ 

Lemma 2.3. Let P be an Rx R permutation matrix. Then for any vector A G F^, 

Diag(nA)n = nDiag(A). (2.6) 



Proof. The lemma follows directly from the definition of permutation matrix. □ 
We are now ready to prove Proposition II. 201 
Proof Let A := AU^ and B := BA^^^n^. Then 

r = [A, B, C]r = [A, B, CHAcIh - [A, B, C]^. (2.7) 

We show that the columns of A and B coincide up to scaling with the corresponding 
columns of A and B, respectively. Consider indices ii, . . . , in-^kc+i such that 1 < 
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ii < ■■■ < iR-kc+i < R- Let TO := fee and let I := {l,...,R}\ {ii, in^k^+i}. 
From Lemma [2.21 it follows that there exists a vector x G such that 



x"^Ci = for i E I and x^C; ^ for i G I'^ = {ii, . . . , iji^kc+i}- 



Let d — [x^Cij 
to 



x^Ci^_^^^^J . Then (A0B)C^x = (A0B)C^x is equivalent 



which may be expressed as 
[a,, . . . a,^_,^^J Diag(d) [b,. 



J© 



i] Diag(d) 



By ()1.12p . min(/cA, fee) > i? — fee + 1- Hence, the matrices [a^^ . . . ai^_^^_|_j] and 
[bij . . . bi^_j.^^j] have full column rank. Since by construction the vector d has 
only nonzero components, it follows that 

ail , ... , ^iR-kc+i ^ spanjaij , ■ • ■ , ^iR-kc+i}^ 



, • • ■ , ^tR-ka+i S span{b,i , . . . , h^^_^^^^ } 



c+i 



By (frT2l) . max(fcA,fcB) > to := R-kc + 2 > 2. Without loss of generality we confine 
ourselves to the case /ca > fn. Then, by Lemma 12. 1[ there exists a nonsingular 
diagonal matrix A such that A = AA. Denoting Aa '■— n-^diag(A~^) and Aa = 
Diag(AA) and applying Lemma 12.31 we have 

A = An = AA^^n = ADiag(nAA)n = AnDiag(AA) = AHAa. 

It follows from ((2?7l) and (fOI) that 

(C A)B^ ^ (CnAc A)B'^ ^ (CnAc AnAA)B'^ = (C A)nAcAAB^. 

Since k_x > R — kc + 2, it follows that condition (Ki) holds for the matrices A and 
C. From Proposition II. 121 (1) it follows that the matrix C A has full column rank. 
Hence, B^ = HAcAaB^, i.e., B = BHA^^A^^ -■ BHAb- □ 

Example 2.4. Consider the 2x3x3 tensor given by T = [A, B, CJs, where 



A = 



1 1 1 

-1 -2 3 





" 6 


12 


2 " 




" 1 





' 


B = 


3 


4 


-1 


, c = 





1 







4 


6 


-4 










1 



Since fc^ + fcg + fcg = 2 + 3 + 3 > 2 x 3 + 2, it follows from Theorem ] 1.8\ that r-y- = 3 
and that the CPD of T is unique. 



A = 



10 11 
112 



, B 



we 


also 


have T — 


[A,B,C 


4 for 




1 





" 






6 


-6 -3 


-2 





1 





, c 




12 


-24 -8 


-6 








1 






2 


6 -3 


-6 
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Since — 2 and k-Q — kc — 3, condition (|1.12p holds. Hence, by Provosition 1 1 . 2(K 
ifT— [A, B, C]4 and C — C, t/ie^ i/iere exists a nonsingular diagonal matrix A such 
that A = AA and B = BA^^. 

T/ie following condition is also satisfied: 

max(niin(fcA, — 1), inin(fcA ^ 1, ^c)) + ks > R + I. 



By symmetry, we have from Provosition \1.2(][ that, ifT~ [A, B, C]4 and B = B, then 
there exists a nonsingular diagonal matrix A such that A = A A and C — CA^-'^. 
Finally, we show that the inequality of condition p.l2p is sharp. We have 

max(min(fcB; ~ 1): niin(fcB — l,fcc)) + fcA — -R<^ + 1- 
One can verify that T ~ [A, B, C]4 with A = A and with B and C given by 



B 



6 12 

3 4 

4 6 



1 
a 
0/3 



1 1 1 

2 4/3 3/2 
-3 3 9 



C = 



1 

l/a 
1/P 



6 -6 -3 -2 
-24/5 48/5 16/5 12/5 
2/15 2/5 -1/5 -2/5 



for arbitrary nonzero a and /3. Hence, there exist infinitely many PDs T — [A, B, C]4 
with A = A; the columns of B and C are only proportional to the columns of B and 
C, respectively, for a = —2/5 and (3 — 1/15. We conclude that the inequality of 
condition (jl.l2l) is sharp. 

2.2. Two factor matrices in common. In this subsection we assume that two 
PDs have the factor matrices A and C in common. We do not assume however that 
in the two PDs the columns of these matrices are permuted in the same manner. The 
result that we are concerned with, is Proposition ll.211 

Proof. Without loss of generality, we confine ourselves to the case 



fee > 2 and min(fcA — l,fcB)+?'c >i?-|-l. 



(2.8) 



We set for brevity r :— rc- Denoting IT = YiAX^c ~ BAaAcH^, we have 

[A^AAA,B,C^cAc]i^ = [AHAHg, BAAAcHg, C]h = [An,B,C]i^. We wiU 
show that, under (|2.8p . [A,B,C]ij — [An,B,C]i^ implies that 11 = 1^. This, in 
turn, immediately implies that IIa = He and B = BIIaA^^A^^. 

(i) Let us fix integers ii, . . . , v such that the columns c,;j , . . . , c^^ form a basis 
of range(C) and let us set {ji, . . . , jfl-r} {1, • ■ • , ^} \ ■ ■ ■ i v}- Let X G jp^x''^ 
denote a right inverse of [c^j^ . . . c^^J , i.e., [c^j^ . . . c^^J X = 1^. Define the 
subspaces E, Ei^ C as follows: 

E = span{ej^^,...ef^_J, 
E,^ = span{ef : cfxfc 7^ 0, / G {ji, . . . ,jfl-r}}, fc £ {1, . . . ,r}. 



By construction, Ei^, C E and ef ^ Ei^ , fc, Z G {1, . . . , r}. 
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(ii) Let US show that Tlspan{Ei^,ef^} — span{i?jj. , } for all k £ {l,...,r}. 
Let us fix k £ {l,...,r}. Assume that C^Xfe has nonzero entries at positions 
fci, . . . , /cL. Denote these entries by ai, . . . ,aL- From the definition of X and Ei^, 
it follows that L < R — r + 1 and span{e^^ , . . . , e^^ } — spa,n{Ei^ ' ^il }■ 

Define = [e^^ . . . e^^] . Then we have 

PfcPi'Diag(C^Xfe)PfcP|^ = Diag(C^Xfe), (2.9) 
P^Diag(C^Xfc)Pfc =Diag([ai ... a^]). (2.10) 

Further, [A,B,C]_r^ = [An,B,C]7?^ implies that 

ADiag(C^Xfc)B^ = AnDiag(C^Xfe)B^. (2.11) 
Using (|2J| - (|2lT1 ). we obtain 

APfcDiag( [ai ... a^] )PIb'^ = APfeP^Diag(C^xfc)PfcP^B^ 

= ADiag(C^Xfc)B^ 
= AnDiag(C^Xfe)B^ 
= AnPfeP^Diag(C^Xfc)PfeP^B^ 
= AnPfeDiag([ai ... aL])P^B^. (2.12) 

Note that BP^ = [hk, ■ ■ ■ bfc^] . Since, by ((2^ . ku > R-r+1 > L, it follows that 
the matrix P^B"^ has full row rank. Further noting that APk = [^ki ■ ■ ■ a-feL] 
and AnPfc = [(An)fei . . . (An)fe^] , we obtain from ((^1^ that 

span{afei, . . . ,afc^} C span{(An)fci , . . . , (An)fe^}. (2.13) 

Since, by (g^, kA>R-r + 2>L + l, ([^1^ is only possible if nspan{£',, , e^^ } = 
span{£;j,,e,^}. 

(iii) Let us show that HE = E. Let us fix j £ {ji, . . . , j_R-r}- From X-^c^j. = 
for k £ {1, . . . , r}, the fact that the vectors c^j^ , . . . , c^^ form a basis of range(C), and 
kc > 2, it follows that the vector X^c^- has at least two nonzero components, say, the 
m-th and n-th component. Since cjx„j and cjx„ 7^ 0, we have ej^ £ Ei^ H Ei^ . 
From the preceding steps we have 

nef £ n(K,„^ n ) n (span{£;,,„ , ef^^ } n span{K,„ , e,^^ }) 

c' span{i;i,„ , e,^^ } n span{£;,„ , ef^ } = E,^ n E,^ C E. 

Since this holds true for any index j £ {j'l, . . . , j_R-r}, it follows that YiE = E. 

(iv) Let us show that Ilef; = e^; for all k £ {l,...,r}. From the preceding 
steps we have 

HE,, y n (span{i;,, , ef^ } n ^) C span{£;,, , e« }r\E'd E,, . 

On the other hand, we have from step (iii) that rispanjE'ij., e|^} = {£'^^.,8^}, with, 
as shown in step (i), ef-^ ^ i?,;^ . It follows that He^ = for all fc G {1, . . . , r}. 

(v) We have so far shown that, if the columns Cij,...,Ci^ form a basis of 
range(C), then 11 [e^ . . . e,^] = [efj . . . ef^] . To complete the proof of the over- 
all equality 11 — 1^, it suffices to note that a basis of range(C) can be constructed 
starting from any column of C. 

□ 
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3. Overall CPD uniqueness. In Proposition 11.221 and Corollaries ll.23H1.2^ 
overall CPD uniqueness is derived from uniqueness of one factor matrix, where the 
latter is guaranteed by Proposition 11.201 In Proposition 11.261 and Corollaries 11.281 - 
11.301 overall CPD is derived from uniqueness of two factor matrices, where the latter 
is guaranteed by Proposition [TT2TJ We illustrate our results with some examples. 

Proof of Proposition [L2B . By (|1.12p . fee > 1 and min(fcA, fee) > mc — 1. Hence, 
by Proposition 1 1 . 14} rj- = R and the third factor matrix of T is unique. The result 
now follows from Proposition 11.201 □ 

Proof of Corollary [TM From Proposition [TH] (3) it follows that (Wm^) holds 
for A, B, and C. Since (Ui) is equivalent to (Ci), it follows from Proposition 11.121 
(7) that A B has full column rank. The result now follows from Proposition 11.221 



Proof of Corollaries \1.24\ and \1.25\ By Proposition 11.121 (2), both (Hnif,) and 
(Cm^) imply (Um^). The result now follows from Corollary 11.231 □ 

Proof o f Provosition [7. 2(]\ . Without loss of generality we assume that (i) and (iii) 
hold. By Proposition [Hn] (9), 

min(/sB,fcc) > "^A > 2, min(fcA,fcB) > mc > 2. (3-1) 

It follows from Proposition 11.141 that r-y = R and that the first and third factor 
matrices of the tensor T are unique. One can easily check that (13. ip implies (|1.13p . 
Hence, by Proposition ll.211 the CPD of T is unique. □ 

Proof of Corollary \1.27\ Without loss of generality we assume that (ii) and (iii) 
hold. From Proposition 11.121 (2) it follows that (ii) and (iii) in Proposition 11.261 also 
hold. Hence, by Proposition 11.261 rq- = R and the CPD of T is unique. □ 

Proof of Corollary \1.28[ By Proposition [02] (2), if two of the matrices in (|1.15|) 
have full column rank, then at least two of conditions (i)-(iii) in Proposition 11.261 
hold. Hence, by Proposition 1 1.26[ r-j- — R and the CPD of T is unique. □ 

Proof of Corollary \1.29i Without loss of generality we assume that (X, Y, Z) = 
(B,C,A). Then, 



rc 
rA 
kc 



rc 



>2R + 2, 

> i? + 2, 

> 2i? + 2, 

> i? + 2. 




holds for 
holds for 



B 
A 



and 
and 



C, 
B, 



where to a = i? — ta + 2 and toc = i? — rc + 2. From Proposition II. 121 (1) it follows 
that the matrices Cm^(B) 0CmA(C) and C„i(,(A) 0Cmc(B) have full column rank. 
Hence, by Corollary 11.281 r^ = R and the CPD of T is unique. □ 

Proof of Corollary 1 1 . 3(A It can be easily checked that all conditions of Corollary 
11.291 hold. Hence, r-y = R and the CPD of T is unique. □ 

Example 3.1. Consider a 5 x 5 x 5 tensor given by the PD T = [A,B,C]6, 
where the matrices A,B, C g C^^^ satisfy 



^A = fB = rc = 0, 



feT 



^c 



For instance, consider 



A 



"1 














* 




"1 


















"1 



















1 


















1 


















1 



















1 


















1 










, c = 








1 




















1 





* 













1 



















1 



















1 



















1 


















1 





On the Uniqueness of the Canonical Polyadic Decomposition — Part II 



15 



where * denotes arbitrary nonzero entries. Then Kruskal's condition (|1.4p does not 
hold. On the other hand, the conditions of Corollary \1.29\ are satisfied. Hence, the 
PD of T is canonical and unique. 

Example 3.2. Consider i/ie 4 x 4 x 4 tensor given by the PD T = [A, B,C]5, 
where 



A = 



1 1 

10 1 

10 1 

1 



1 1 

10 1 

10 

1 1 



c = 



1 











1 





1 

















1 





1 











1 


1 



We have 



= = fee = 3, TTiA = rn-B = mc = 3. 



Hence, Kruskal's condition (|1.4p does not hold. Moreover, condition (Ks) does not 
hold for (A,B), (C, A), nor (B,C). Hence, the conditions of Corollarv \1.29\ are not 
satisfied. On the other hand, we have 



C3(A)0C3(B) 
C3(C)0C3(A) 
C3(B)0C3(C) 



,16 
-1.5 



-11 



,16 
-11 



-1,-3 



,16 

-6,10 



-16 



^16 

= 1.4 ^6,-14 



,16 1 
-11.12,15,161 ' 



_pl6 f,16 pl6 „16 „i 

'^g '='10,11 ^^16 '='1,13 '^6,16,-8,-14 ^^11,12] i 



,16 



,16 



-5,6 ^=11 "=11,-3 



,16 



,16 



„16 „16 „16 „i 

ej^g tii_4_i3,i6 ^^6,-8 ''ll,15j j 



where 

,16 



e-1 •= e^^ ± e 



16 



„16 ._ „16 

^i,j,±k,±l ■— 



i,j,k,l e {1,...,16}. 



It is easy to check that the matrices C^IA) QC^CB) , C^^C) QC^^A) and C3(B) 0C3(C) 
have full column rank. Hence, by Corollary \1.28[ the PD is canonical and unique. 

One can easily verify that iJAB {^) ~ P^BC i^) ~ PtcA (^) = min(5, 3) . Hence the 
uniqueness of the CPD follows also from Corollary \1.27\ 

Note that, .since condition (II. 12^ does not hold, the result does not follow from 
Proposition \1.22\ and its Corollaries \1.23W1.23[ 

Example 3.3. Consider the 5 x 5 x 8 tensor given by the PD T = [A, B,C]8, 
where 



A 



5x8 



B 



B 

{47. 



5x8 



and A and B are 4x8 matrices such that fc^ = fcg = 4. We have va — r-Q — 
kA = fce = 4, and rc = kc ~ 8. One can easily check that 



5, 1 < (5 < 4, 
i?AB {5) = {i, 6 = 5, > mm{S, 8-8 + 2) 
2, 6 < (5 < 8 
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and that condition (jl.l2l) holds. Hence, by Corollary \1.24\ the PD is canonical and 
unique. On the other hand, H-qc{5) — Hca{S) = 4 < min((5, 8 — 5 + 2) for S — 5. 
Hence, the result does not follow from Corollary \1.27\ 
Example 3.4. Let 



A = 



10 11 
10 12 
113 



B 



10 11 
10 13 
115 



C = l5 



It has already been shown in 1171 that the CPD of the tensor T = [A, B, CJs is unique. 
We give a shorter proof, based on Corollary 1 1 . 23[ It is easy to verify that 



C2(A)0C2(B) 



1 


1 


6 





1 


1 








2 





1 


10 

















4 














-1 


-5 








2 





1 


9 

















4 


1 


1 


15 











1 


1 


8 




















1 


3 


4 














-1 


-3 








2 




















1 


2 


4 











1 


1 


15 


1 


6 


2 


an{ [0 





-4 








2 




-4 






Ifde 



ker(C2(A)0C2(B)) = 

is such that diag(C2(Diag(d))) G ker(C2(A) 0C2(B)), we have 

didr^ = 



did2 = 0, 
dids ^ 0, 
didi ~ —4c, 
d\d^ — 0. 



^2^3 = 0, 
did^ = 2c, 
did^ = 0, 



^3^5 



-4c, 



0, 



One can check that this set of equations only has a solution if c = 0, in which case 
d = 0. Hence, by Corollary \1.23\ the PD is canonical and unique. Note that, since 
toa — Tn-B = 5 — 3 + 2 = 4, the rriA-th compound matrix of A and the m-Q-th compound 
matrix of B are not defined. Hence, the uniqueness of the matrices A and B does not 
follow from Proposition \1.26l 

Example 3.5. Experiments indicate that for random 7 x 10 matrices A and B, 
the matrix Aq'B has full column rank and that condition (Us) does not hold. Namely, 
the kernel of the 441 x 252 matrix C5(A) 0C5(B) is spanned by a vector associated 
with some d G F^". Let C fee a 7 x 10 matrix such that d ^ range(C^). Then (Ws) 
holds for the triplet (A, B,C). // additionally kc > 5, then (jl.l2l) holds. Hence, by 
Proposition 1 1 . 2^ rj- — 10 and the CPD of T = [A, B,C]io is unique. 

The same situation occurs for tensors with other dimensions (see Table lKT]) . 

4. Application to tensors with symmetric frontal slices and Indscal. In 

this section we consider tensors with symmetric frontal slices (SFS), which we will 
briefly call SFS-tensors. We are interested in PDs of which the rank-1 terms have 
the same symmetry. Such decompositions correspond to the INDSCAL model, as 
introduced by Carroll and Chang [T]. A similar approach may be followed in the case 
of full symmetry. 
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Table 3.1 

Some cases where the rank and the uniqueness of the CPD of T = [A,B,C]i{ may be easily 
obtained from Proposition 1 1 . 2M or its Corollary \1.23\ (see Examt)le \3.5V . Matrices A, B and C are 
generated randomly. Simulations indicate that the dimensions of A and B cause the dimension of 
ker(Cm(A) 0Cm(B)) to be equal to 1. Thus, (Um) and (Wm) may be easily checked. 



dimensions of T, 
I X J X K 


rr = R 


m=R-K+2 


dimensions of 
C„{A) 0C,„(B) 


(Um) 


(Wm) 


4x5x6 


7 


3 


40 X 35 


does not hold 


holds 


4 X 6 X 14 


14 


2 


90 X 91 


holds 


holds 


5x7x7 


9 


4 


175 X 216 


does not hold 


holds 


6x9x8 


11 


5 


756 X 462 


does not hold 


holds 


7x7x7 


10 


5 


441 X 252 


does not hold 


holds 



We start with definitions of SFS-rank, SFS-PD, and SFS-CPD. 

Definition 4.1. A third-order SFS-tensorT e y'^''^^ is SFS-rank-1 if it equals 
the outer product of three nonzero vectors a £ , a G and c G F^ . 

Definition 4.2. A SFS-PD of a third-order SFS-tensor T G F-^^-^^^ expresses 
T as a sum of SFS-rank-1 terms: 

R 

7" = a^ o a^ o Cr, (4-1) 

where a^ G F^ G F^^, 1 < r < R. 

Definition 4.3. The SFS-rank of a SFS-tensor T G F-^^-'^^-'^ is defined as the 
minimum number of SFS-rank-1 tensors in a PD of T and is denoted by rsFS.T- 

Definition 4.4. A SFS-CPD of a third-order SFS-tensor T expresses T as a 
minimal sum of SFS-rank-1 terms. 

Note that r = [A, B, C]^^ is a SFS-CPD of T if and only if T is an SFS-tensor, 
A = B, and R — rsFS,T- 

Now we can define uniqueness of the SFS-CPD. 

Definition 4.5. Let T be a_ SFS-tensor of SFS-rank R. The SFS-CPD ofT is 
unique ifT— [A, A, CJ^ = [A, A, CJ^ implies that there exist an Rx R permutation 
matrix 11 and R x R nonsingular diagonal matrices Aa and Ac such that 

A^AHAa, C = CnAc, AiAc = Iii. 

Example 4.6. Some SFS-tensors admit both SFS-CPDs and CPDs of which the 
terms are not partially symmetric. For instance, consider the SFS-tensor T G R^^^^^ 
in which 1/ is stacked K times. Let E denote the K x I matrix of which all entries 
are equal to one. Then T = [X, (X^^)^, E]/, is a CPD ofT for any nonsingular I x I 
matrix X. On the other hand, T — [A, A, E]/, is a SFS-CPD ofT for any orthogonal 
L X L matrix A. 

The following result was obtained in [20]. We present the proof for completeness. 

Lemma 4.7. Let T be a SFS-tensor of rank R and let the CPD ofT be unique. 
Then rsFS,T — """Tj '^'^d the SFS-CPD ofT is also unique. 

Proof. Let [A,B,C]7? be a CPD of the SFS-tensor T. Because of the symmetry 
we also have T = [B, A, C]/? . Since the CPD of T is unique, there exist an R x R 
permutation matrix 11 and R x R nonsingular diagonal matrices Aa, Ab, and Ac 
such that B = AIIAa, A = BIIAb, C = CIIAc and AaAbAc = Ir- Since the 
CPD is unique, by p.lSp . we have kc > 2. Hence, 11 = Ac — Ir. and B = AAa. 
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Thus, any CPD of T is in fact a SFS-CPD. Hence, rsFS,T = rr, and the SFS-CPD 
of T is unique. □ 

Remark 4.8. To the authors' knowledge, it is still an open question whether 
there exist SFS-tensors with unique SFS-CPD but non-unique CPD. 

Lemma 14.71 impHes that conditions guaranteeing uniqueness of SFS-CPD may be 
obtained from conditions guaranteeing uniqueness of CPD by just ignoring the SFS- 
structure. To illustrate this, we present SFS- variants of Corollaries 11.251 and 11.281 

Proposition 4.9. Let T = [A, A, CJ^ and mc := i?. - rc + 2. Assume that 

(i) kA + kc>R + 2; 

(ii) Cmc (A) Cmc (A) has full column rank. 

Then rsFS,T — R '"^'^ t^^^ SFS-CPD of tensor T is unique. 

Proof. From Corollary II. 251 it follows that rq- — R and that the CPD of tensor T 
is unique. The proof now follows from Lemma 14.71 □ 

Remark 4.10. Under the additional assumption rc — R, Proposition \4-9\ was 
proved in 115^ . 

Proposition 4.11. Let T = [A, A, C]^ and := i? - + 2. Assume that 

(i) + max(min(fcc — 1, ^a), min(fcc, — 1)) > + 1; 

(ii) C„i^(A) Q Cmj^{C) has full column rank. 

Then rsFS,T = R o^*^ t^T-^ SFS-CPD of tensor T is unique. 

Proof. By Lemma 14.71 it is sufficient to show that r-j- = R and that the CPD of 
tensor T is unique. Both these statements follow from Corollary 11.251 applied to the 
tensor [A, C,A]fl,. □ 

Proposition 4.12. LetT = [A,A,C]r, niA = R-rA + '2 andmc = R-rc + 2. 
Assume that the matrices 

C™^(A)0C„,^(C), (4.2) 

C,na{A)&C,na{A) (4.3) 

have full column rank. Then rsFS,T = R '"^'^ ^^^6 SFS-CPD of tensor T is unique. 

Proof. From Corollary II. 281 it follows that r-y- = R and that the CPD of tensor T 
is unique. The proof now follows from Lemma 14.71 □ 

5. Uniqueness beyond (Wm). In this section we discuss an example in which 
eyen condition (Wm) is not satisfied. Hence, CPD uniqueness does not follow from 
Proposition 1 1 . 1 31 or Proposition 11.141 A fortiori, it does not follow from Proposition 
[L221 Corollaries[r23Hll25l Proposition[r26l and Corollaries HUHHOOl We show that 
uniqueness of the CPD can nevertheless be demonstrated by combining subresults. 

In this section we will denote by a;(d) the number of nonzero components of d 
and we will write a || b if the vectors a and b are coUinear, that is there exists a 
nonzero number c G F such that a ~ cb. 

For easy reference we include the following lemma concerning second compound 
matrices. 

Lemma 5.1. /?, Lemma 2.4 (1) and Lemma 2.5] 

(1) Let the product XYZ be defined. Then the product C2(X)C2(Y)C2(Z) is also 
defined and 

C2(XYZ) =C2(X)C2(Y)C2(Z). 

{2) Letd=[di d2 ... d^] e F«. T/ien C2(Diag(d)) = Diag(d2). 

Ln particular, uj{d) < 1 if and only if — if and only i/C2(Diag(d)) = 0. 
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Example 5.2. Let Ta — [A,B,C]5, where 



a 

10 10 

10 10 

1 



10 

10 10 

1 

1 1 



110 

10 

1 

1 1 



a ^ 0. 



Then = rs = rc — 4, kjs^ — k-B = kc = '2, and ni := ttia = m-B — fnc = 
5 — 4 + 2 = 3. One can check that none of the triplets {A, ^,C), (B,C,A), (C,A, B) 
satisfies condition (Wm) . Hence, the rank and the uniqueness of the factor matrices 
ofTa do not follow from Provosition \1.13\ or Proposition \1.14\ We prove that rj-^ = 5 
and that the CPD Ta = [A,B, CJs is unique. 
(i) A trivial verification shows that 



AqB, B0C, C0A, have full column rank, 

C2(A) C2(B), C2(B) C2(C), C2(C) C2(A) have full column rank. 

Elementary algebra yields 



a;(A^x) = 1 ^ x|| or x || e; 
w(B'^y) = 1<^ y|| or y \\ e 



a;(C^z) = 1 O z 



(5.1) 
(5.2) 



(5.3) 
(5.4) 
(5.5) 



(ii) Consider a CPD Ta = [-A,B,C]^, i.e. R — rj-^ is minimal. We have 
R < 5. For later use we show that any three solutions of the equation uj{C'^z) = 1 
are linearly dependent. Indeed, assume that there exist three vectors Zi, Z2, Z3 G 
such that w(C^zi) = ^(C^za) = a;(C'^Z3) = 1. By ([121) - {L^ . 



T(i) = (A B)C^ = (A B)C^, 
T(2) = (B C)A^ = (B C)A^, 
t(3) = (C A)B^ = (C A)B^. 



(5.6) 
(5.7) 
(5.8) 



From (HH) it follows t/iat ADiag(C^z,)B^ = ADiag(C^Zj)B'^, and hence, by Lemma 

O (1), 

C2(A)C2(Diag(C^z,0)C2(B^) = C2(A)C2(Diag(C^zO)C2(B^) = O, z e {1, 2, 3}, 



which can also be expressed as 
[C2(A)0C2(B)]d2 



0, 



C^z„ {1,2,3}. 



By (j5.2l) . (if — for i G {1,2,3}. Since C'^ has full column rank. Lemma \5.1\ (2) 
implies that aj(C"^zi) = ti;(C^Z2) = ujiC'^T.^) = 1. From (j5.5p it follows that at least 
two of the vectors Zi, Z2, and Z3 are collinear. Hence, the vectors Zi, Zi, and Z3 are 
linearly dependent. 

(iii) Since A0B and C"^ have full column rank, from (|5.6p and Sylvester's rank 
inequality it follows that 

Tc-r > ?'(AOB)cr = r(AOB)Cr > ^aob +rcT - 5 = 5 + 4- 5 = 4. 

In a similar fashion, from (j5.7p and (15. 8p we obtain r^T > 4 and r-^T > 4, respec- 
tively. We conclude that R > r^ = r-^ = r^; ~ 4. 
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Let us show that R — 5. To obtain a contradiction, assume that R — 4. In this 
case, since Tq^t = 4, C"^ is a nonsingular square matrix. Then the columns of Zi := 
{C^)~^ are linearly independent solutions of the equation a;(C^z) = 1, which is a 
contradiction with (ii). Hence, R = 5. 

(iv) Let us show that fcg. > 2. Conversely, assume that fcg. = 1. Since rg. — 4, 
it follows that there exists exactly one pair of proportional columns of C. With- 
out loss of generality we will assume that C4 || C5. Hence, ¥^ — range(C) = 

span{Ci,C2,C_3,C4}. Let [z^ zg Z4] := ([Ci C2 C3 C^f)-^. Then 

a;(C'^Zi) = aj(C"^Z2) = a;(C Z3) — 1, which is a contradiction with (ii). 

In a similar fashion we can prove that k^>2 and fcg > 2. Thus, min(fc^, k-Q^k^) > 

2. 

(v) Assume that there exist indices i,j,k,l and nonzero values ^1,^2,^3,^4 such 

that 

(A^)i=iie5, (A^)4=t2ef, (6^)1=^36^, (6^)3 = ^46^. (5.9) 

Here we show that (|5.9p implies the uniqueness of the CPD of Ta o,nd a fortiori the 
uniqueness of the third factor matrix. The latter implication will as such be instru- 
mental in the proof of (vi) . That assumption (|5.9p really holds, and thus implies CPD 
uniqueness, will be demonstrated in (vii). 
Combination of (|5.7p . (|5.8p . and (|5.9p yields 

ab2 (8) C2 = iibi ® Ci, C2 (g) a2 = ^sCj. (g) a^, 

bs (g) C5 = t2hj (g) Cj, C4 g) a4 = t^ci g) a;. 

We see that b2 || b^. Also, C2 || Ci and C2 || Cfc. Since fcg. > 2, it follows that i = k. 
Therefore, also a2 || a^. It is now clear that [a2,b2,C2]i — [ai,hi,Ci]i = f3[ef,ef,ef] 
for some /3 G F. Let 

Tp -.^Ta- [a2,b2,C2]i + I3[e\,e\,e\] = [A, B,C]5 - [a^ , b,; , Ci] 1 . 

Obviously, T[j is rank-A. We claim that /3 = 0. Indeed, if (5 ^ 0, then repeating steps 
(i)~(iii) for Ta replaced by Tjs we obtain that Tg is rank-5, which is a contradiction. 
Hence, [a2,b2,C2]i = [ai,bi,Ci]i. 

What is left to show, is that the CPD of the rank-A tensor 7^ — [a2, b2, C2]i is unique. 
Note that the matrix [ci C3 C4 C5] has full column rank. From (|5.2p it follows 
thatC2{[sLi a3 a4 a5])0C2([bi b4 bs]) also has full column rank. Hence, 

by Proposition the CPD of Ta — [a2,b2,C2]i is unique. 

(vi) Let us show that k^ = k-^ — k(^ = 2. Conversely, assume that k(~; > 3. 
Then rg + feg; >4 + 3>i? + 2. Recall from (iv) that fcg > 2. Hence, condition (K2) 
holds for B, C. By Provosition \1.12\ (1), 

C2(B) 0C2(C) has full column rank. (5.10) 
Let X e F''. From ([5J)) it follows that 

BDiag(A^x)C^ = BDiag(A^x)C^, 
Hence, by Lemma \5.1\ ( 1 ), 

C2(B)C2(Diag(A^x))C2(C^) - C2(B)C2(Diag(A^x))C2(C^), 
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which can also be expressed as 

[C2(B) C2(C)] di = [C2(B) C2(C)] d\, (5.11) 

where cIa = A^x and = A"^x. From (|5.2[) . (|5.10|) . and Lemma \5.1\ (2) it follows 
that 



V / A. A 

% c.(A^x) = 1. 



(5.12) 



In a similar fashion we can prove that for y G F^, 

a;(B^y) = 1 ^ tj(B'^y) 1. (5.13) 

Therefore, by (i), there exist indices i,j,k,l and nonzero values ^1,^2,^3,^4 such that 
(|5.9p holds. It follows from step (v) that the matrices C and C are the same up to 
permutation and column scaling. Hence, — kc ~ 2, which is a contradiction with 
kc ^ 3. We conclude that fcg. < 3. On the other hand, we have from (iv) that k^ > 2. 
Hence, k^ = 2. 

In a similar fashion we can prove that k^ = /cg = 2. 

(vii) Since k^ — k-^ ~ 2, both A and B have a rank- deficient 4x3 submatrix. 
Since r ~ r-Q = 4, it follows that there exist vectors Xi, X2, yi, y2 such that 

c^(A^xi)=c^(A^X2)=c<.(B^yi)-c<.(B^y2) = l, Xi ^X2, yi ^y2. 

From dnH]) -(11331) it follows thatuj{A'^Xi) = a;(A^X2) w(B^yi) = a;(B^y2) = 1. 
By (15.31) - (j5.4p there exist indices i,j,k,l and nonzero values ^1,^2,^3,^4 such that 
(|5.9p holds. Hence, by (v), the CPD of is unique. 

6. Generic uniqueness. 

6.1. Generic uniqueness of unconstrained CPD. It was explained in [HITC] 
that the conditions rc — R and (C2) in Proposition 11.151 hold generically when they 
hold for one particular choice of A, B and C. It was indicated that this implies that 
the CPD of an / X J X if tensor T = [A, B, CJ^ is generically unique whenever K > R 
and CjCj > C\. These conditions guarantee that the matrix C generically has full 
column rank and that the number of columns of the CjCj x C|. matrix C2(A) 0C2(B) 
does not exceed its number of rows. In this subsection we draw conclusions for the 
generic case from the more general Proposition 11.141 and Corollarv ll.251 

As in (im^, our proofs are based on the following lemma. 

Lemma 6.1. Let /(x) be an analytic function of'x. G F" and let fin be the Lebesgue 
measure on F". If fin{^ ■ /(x) = 0} > 0, then f = 0. 

Proof. The result easily follows from the uniqueness theorem for analytic functions 
(see for instance [11] Lemma 2, p. 1855]). □ 

The following corollary trivially follows from Lemma 16.11 

Corollary 6.2. Let /(x) be an analytic function of x F" and let fin be the 
Lebesgue measure on F". Assume that there exists a point xq such that /(xq) ^ 0. 
Then At„{x : /(x) = 0} = 0. 

We will use the following matrix analogue of Corollary 16.21 

Lemma 6.3. Let F(x) = {fpq{^))p'^=i, with P > Q, be an analytic matrix-valued 
function ofxG F" ( that is, each entry fpq (x) is an analytic function ofx) and let fin 
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be the Lebesgue measure on F". Assume that there exists a point xq such that F(xq) 
has full column rank. Then 

/i„{x : F(x) does not have full column rank} — 0. 

Proof Let f(x) := Cq(F(x)) and L := C% Then f : F" ^ F-^ : x ^ f(x) = 

[/i(x) . . . /i(x)]^ is a vector- valued analytic function. Note that f(x) = if and 
only if the matrix F(x) does not have full column rank. Since f(xo) ^ 0, there exists 
Zq S {1, . . . , L} such that //(,(x) ^ 0. Hence, by Corollarv l6.21 ^„{a; : /;o(x) = 0} = 0. 
Therefore, 

/x„{x : F(x) does not have full column rank} = /in{x : f(x) = 0} 
=M« ^r\{^ ■■ /i(x) - 0}| < fin{x : /io(x) = 0} - 0. □ 

The following lemma implies that, if kc = rc, then ()1.12p in Proposition 11.201 
holds generically, provided there exist matrices Aq G F'^^-'^ and Bq e F"'^^ for which 
Cmc(Ao) Cmc(Bo) has full column rank. 

Lemma 6.4. Suppose the matrices Aq G F'^^-'^, Bq G F"'^-'^, and C G F^^^ 
satisfy the following conditions: 

kAo = niin(/, R), k^o = niin(J, R), kc ^ rc- 

Suppose further the matrix Cmci-^o) G Cmci^o) has full column rank, where m = 
R-rc + 2. Then 

max(min(/, J - 1, i? - 1), min(/ - 1, J, R - 1)) + kc > R + 1. (6.1) 



Proof. By Proposition ll.121 (2) and (9), min(A:Ao , fceo) ^ '^ic- Hence, 
min(/, J, R) > min(fcAo, ^Bo) ^ t^t-c ^ R — rc + 2 = R — kc + 2. 
Therefore, 

max(min(/, J - 1, i? - 1), min(/ - 1, J, i? - 1)) + kc > min(/ - 1, J - 1) + fcc 

>i?-fcc + 2- l + A:c=i?+l. 

Hence, (jOj) holds. □ 

The following proposition is the main result of this section. 

Proposition 6.5. Let the matrix C G F-^^-'^ be fixed and suppose fcc > 1. 
Assume that there exist matrices Aq g F"'^^"^ and Bq G F"^^^ such that Cm(Ao) 
C„i(Bo) has full column rank, where m ^ R — rc + 2. Set n = [I + J)R. Then 

(i) 

/i„{(A, H) : T :— [A, B, CJ^ has rank less than R or 

the third factor matrix of T is not unique} — 0. 

(ii) // additionally, kc = rc, or (j6.ip holds, then 

/i„{(A,B) : T := [A, B,C]/j' has rank less than R or 

the CPD of T is not unique} = 0. 
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Proof, (i) Let P := CJ'Cf, Q := C'^, n (/ + J)i?, x := (A,B), xq := (Ao,Bo) 
and F(x) :— C„j(A) 0Cm(B). Since fee > li from ProDOsition ll.141 and Lemma 15751 it 
follows that 

/i„{(A, B) : T := [A, B, C]_r has rank less than R or 

the third factor matrix of T is not unique} 
< /i„{(A,B) : Cm (A) 0C,„(B) does not have full column rank} = 0. 

(ii) By Lemma we can assume that (|6.ip holds. We obviously have 

^„{(A, B) : /sa < min(/, R) or ks < min( J, R)} = 0. 

Hence, by 

/i„{(A,B) : (frra does not hold} = 0. 

From Proposition 11.201 and (i) it follows that 

^„{(A, B) : T := [A, B, Cjn has rank less than R or 

the CPD of T is not unique} 
< /L(„{(A, B) : T := [A, B, C]ii has rank less than R or 

the third factor matrix of T is not unique or 
pTT^ does not hold} = 0. □ 

Proposition 6.6. The CPD of an I x J x K tensor of rank R is generically 
unique if there exist matrices Aq £ F^^^ and Bq G F'^x-R such that Cm(Ao) 0Cm(Bo) 
has full column rank, where m = R — min(if, R) +2. 

Proof Generically we have rc = mm{K, R). Let N = {I+J+K)R, n = {I+J)R, 
and let ri = {C : fee < ?"c} C F^^-'^. By application of Lemma [6.31 one obtains that 
Hkb.{^) — 0. From Proposition 16.51 it follows that (|6.2p holds for C ^ il. Now 

/iAr{(A, B, C) : T [A, B, C]fl, has rank less than R or 

the CPD of T is not unique} = 

follows from Fubini's theorem [HI Theorem C, p. 148]. □ 

Proof of Proposition \1.31[ Proposition 11.311 follows from Proposition 16.61 by per- 
muting factors. □ 

6.2. Generic uniqueness of SFS-CPD. For generic uniqueness of the SFS- 
CPD we resort to the following definition. 

Definition 6.7. Let /i be the Lebesgue measure on w''^^+^^^-. The SFS-CPD of 
an I X I X K tensor of SFS-rank R is generically unique if 

/i{(A, C) : the SFS-CPD of the tensor [A, A, C]r is not unique } = 0. 

We have the following counterpart of Proposition [L3T] 

Proposition 6.8. The SFS-CPD of an I x I x K SFS-tensor of SFS-rank R 
is generically unique if there exist matrices Aq g F^^"^ and Cq G f^^^ such that 
C„ic(Ao) Cmc(A-o) or Cm^(Ao) CmA(Co) has full column rank, where mc = 
R - min(ii', i?) + 2 and toa = R- min(/, i?) + 2. 

Proof. The proof is obtained by combining Proposition 11.311 and Lemma 14.71 □ 
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6.3. Examples. Example 6.9. This example illustrates how one may adapt the 
approach in sub sections ] 6. 1\ and \6.2\ to particular types of structured factor matrices. 

Let X4 be the 4x4x4 tensor with ones on the main diagonal and zero off- 
diagonal entries and Zei 7" = 14 + a o b o c be a generic rank-1 perturbation of X4 . 
Then T = [[I4 a], [I4 b], [I4 c]]5. Since the k-ranks of all factor matrices of T are 
equal to A, it follows from Kruskal's Theorem \1.8\ that r-j- — b and that the CPD of T 
is unique. 

Let us now consider structured rank-l perturbations a o b o c that do not change 
the fourth vertical, third horizontal, and second frontal slice 0/I4. The vectors a, b, 
and c admit the following parameterizations 

a = [ai 02 as O] , b = [61 62 64] , c = [ci C3 C4] , 

with Oi, bj, Ck G F. 

Now the k-ranks of all factor matrices 0/ 7" := I4 + a o b o c are equal to 3, and 
(generic) uniqueness of the CPD of T does not follow from Kruskal's Theorem ] 1.81 
We show that 

//g{(a, b, c) : the CPD 0/ 7" := 24 + a o b o c is not unique or r-f < 5} = 0, 

that is, the CPD of rank-l structured generic perturbation 0/I4 is again unique. 

Let the matrices Aq, Bq, and Cq be given by the matrices A, B, and C, respec- 
tively, in Example \3.2[ As in Example \ 3.2\ the matrix pairs (Ao,Bo), (Bo,Co), and 
(Co, Aq) satisfy condition (Cs). Then, by Lemma \6.3[ 

/XgKa, b) : C3(A) 0C3(B) does not have full column rank} — 0, 
/X6{(b,c) : C3(B) Q C^{C) does not have full column rank} ~ 0. 

By Fubini's theorem 19, Theorem C, p. 14-8], 

/j,9{(a, b, c) : C3(A) C3(B) has not full column rank or fee < 3 or rc < A} — 0, 
/j,9{(a, b, c) : C3(B) Q £3(0) has not full column rank or kjs^ < 3 or ta < 4} = 0. 

Now generic uniqueness of the structured rank-l perturbation ofl^ follows from Propo- 
sition \1.2l[ 

Example 6.10. Let T = [A, B, C]^, denote a PD of an I x I x {21 - 1) tensor, 
where / > 4. Generically, k^ ~ k-Q = I and kc — 21 — 1. Then Kruskal's condition 
()1.4|) guarantees generic uniqueness for R < [-^^tl+^^i^J — 2/ — 1. 

On the other hand, lil.ll}) guarantees generic uniqueness of the CPD under the 
conditions R < 21 — 1 and < (C|)^. The maximum value of R that satisfies these 
bounds is shown in the column corresponding to mc — 2 in Table \6.1\ The condition 
in Theorem \1.18\ is even more relaxed. 

We now move to cases where R > 21 — 1, where Theorem ll. 18\ no longer applies. 
By Proposition \6.6\ the CPD ofT of an I x I x [21 — 1) tensor of rank R is generically 
unique if there exist matrices Aq G and Bq G F^^^ such that Cmc(-^o) 

Cmc(-^o) has full column rank, where mc = i? — {21 — 1) + 2 = i? — 27 + 3. The 
proof of Provosition 1 6. 6\ shows that, if there exist Aq and Bq such that C„,.c(Ao) 
Cmc(Bo) has full column rank, then actually Cmd-^o) 0Cmc(Bo) has full column 
rank with probability one when Aq and Bq are drawn from continuous distributions. 
Hence, we generate random Aq and Bq and check up to which value of R the matrix 
Cmc(Ao) 0Cmc (Bq) has full column rank. Table W7l\ shows the results for 4 < / < 9. 
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For instance, we obtain that the CPD o/ a 9 x 9 x 17 tensor of rank R is generically 
unique if R < 20. (By of comparison. Theorem \1.18\ only guarantees uniqueness up 
to R= 17.) 

Proposition \6.6\ corresponds to condition (i) in Proposition \1.31\ . Note that, for 
i? > 2/ — 1, we generically have toa = = i?, — / + 2>/+l such that the ms-th 
compound matrix of K and the m^-th compound matrix o/B are not defined. Hence, 
we cannot resort to condition (ii) or (Hi) in Provosition M .31\ 

Table 6.1 

Upper bounds on R under which generic uniqueness of the CPD of an I X I X (21 — 1) tensor 
is guaranteed by Proposition 1 6. 61 



dimensions of T 
7 X / X (2/ - 1) 


m 


= R- 


-27^ 


-3 


2 


3 


4 


5 


4x4x7 


7 








5x5x9 


9 








6 X 6 X 11 


11 


12 






7 X 7 X 13 


13 


14 






8 X 8 X 15 


15 


16 


17 




9 X 9 X 17 


17 


18 


19 


20 



Remark 6.11. For I = i and R = 21 - I = b, the CPD of an I x I x {21 - 1) 
tensor T is not generically unique UHf , llTj - This is the reason why in Table [EA\ we 
start from 7 = 4. 

Remark 6.12. It was shown in jll. Corollary 1, p. 1852] that the matrix Ci{ A.) Q 
Ci(B) = A B has full column rank with probability one when the number of rows of 
A B does not exceed its number of columns. The same statement was made for the 
matrix C2{A.) 0C2(B) in J^\16f. However, the statement does not hold for compound 
matrices of arbitrary order. For instance, it does not hold for C5 (A) 0C5(B), where 
A e and B e F^^^. 

Example 6.13. Let T — [A,B,C]9 denote a generic PD in 9 terms in the 
6x7x6 case. Then m^^ — mc = 9 — 6 + 2 = 5 and ms = 9 — 7 + 2 — 4. The matrices 
Mc := C5(A) 0C5(B) and Ma := CsiB) Q C^iC) have C|Cf = C| = 126 rows and 
columns. Numerical experiments indicate that dimker(Mc) = dimker(MA) — 15 
with probability one. Hence, we cannot use Proposition \1.31\ (i) or (ii) for proving 
uniqueness of the CPD. On the other hand, the CqCq x C| (225 x 126) matrix Mb := 
C4(C) 0C4(A) turns out to have full column rank for a random choice of A and C. 
Hence, by Proposition \1.31\ (iii) , the CPD is generically unique. 

Example 6.14. Here we consider I x I x K tensors with I G {4, ... ,9} and 
K g {2, . . . , 33}, which is more general than Examvle \6.1(A 

We check up to which value of R one of the conditions in Proposition \1.31\ holds 
for a random choice of the factor matrices. Up to this value the CPD is generically 
unique. The results are shown as the left-most values in Table \ 6.Sl We also check 
up to which value of R one of the conditions in Proposition \6.8\ holds for a random 
choice of the factor matrices. Up to this value the SFS-CPD is generically unique. 
The results are shown as the middle values in Table [KM 

The right-most values correspond to the maximum value of R for which generic 
uniqueness is guaranteed by Kruskal's Theorems 1 1 . iglFT. 1 (j\ i.e., the largest value of R 
that satisfies 2 min(/, i?) + min(iir, i?) > 2R + 2. Note that Kruskal's bound is the same 
for CPD and SFS-CPD. The hold values in the table correspond to the results that 
were not yet covered by Kruskal's Theorems 1 1 . 8[^. 1 U\ or Provosition M. 1^ (m = 2). 
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Table 6.2 

Upper bounds on R under which generic uniqueness of the CPD (left and right value) and 
SFS-CPD (middle and right value) of an I X I X K tensor is guaranteed by Provosition 1 1 . 3l\ (left), 
Proposition 16. 51 (middle), and Kruskal's Theorems I j.gltj. jQl (right). The values shown in bold 
correspond to the results that were not yet covered by Kruskal's Theorems 1 1 . g|f7 .10\ or Proposition 
[77751 (m = 2). 





I 






4 






5 






6 




7 


8 




9 




2 


4, 


4, 4 


5, 5, 


5 




6, f 


), 6 


7, 7, 7 


8, 8, 8 


9, 9, 9 




3 


4, 


4, 4 


5, 5, 


5 




6, ( 


i, 6 


7, 7, 7 


8, 8, 8 


9, 9, 9 




4 


5, 


5, 5 




3, 6, 


6 




7, 7, 7 


8, 8, 8 


9, 9, 9 


10, 10, 


10 




5 


5, 


5, 5 




3, 6, 


6 




7, 7, 7 


8, 8, 8 


10, 10, 9 


11, 11, 


10 




6 


6, 


6, 6 


7, 7, 


7 




8, 8, 8 


9, 9, 9 


10, 10, 10 


11, 11, 


11 




7 


7, 


6, 6 


8, 7, 


7 




9, 8, 8 


9, 9, 9 


11, 11, 10 


12, 12, 


11 




8 


8, 


6, 6 


9, 8, 


8 




9, 9, 9 


10, 10, 


10 


11, 11, 11 


12, 12, 


12 




9 


9, 


6, 6 


9, 9, 


8 


10, 10, 9 


11, 10, 


10 


12, 11, 11 


13, 13, 


12 




10 


9, 


6, 6 


10 


10, 


8 


11, 


10, 


10 


12, 11, 


11 


13, 12, 12 


14, 13, 


13 




11 


9, 


6, 6 


11 


10, 


8 


12, 


11, 


10 


13, 12, 


11 


14, 13, 12 


15, 14, 


13 




12 


9, 


6, 6 


12 


10, 


8 


13, 


12, 


10 


14, 13 


12 


15, 14, 13 


15, 15, 


14 




13 


9, 


6, 6 


13 


10, 


8 


14, 


13, 


10 


14, 14 


12 


15, 15, 13 


16, 15, 


14 




14 


9, 


6, 6 


14 


10, 


8 


14, 


14, 


10 


15, 15 


12 


16, 15, 14 


17, 16, 


15 




15 


9, 


6, 6 


14 


10, 


8 


15, 


15, 


10 


16, 15, 


12 


17, 16, 14 


18, 17, 


15 




16 


9, 


6, 6 


14 


10, 


8 


16, 


15, 


10 


17, 16, 


12 


18, 17, 14 


19, 18, 


16 


K 


17 


9, 


6, 6 


14 


10, 


8 


17, 


15, 


10 


18, 17, 


12 


19, 18, 14 


20, 19, 


16 


18 


9, 


6, 6 


14 


10, 


8 


18, 


15, 


10 


19, 18, 


12 


20, 19, 14 


20, 20, 


16 




19 


9, 


6, 6 


14 


10, 


8 


19, 


15, 


10 


20, 19, 


12 


20, 20, 14 


21, 20, 


16 




20 


9, 


6, 6 


14 


10, 


8 


20, 


15, 


10 


20, 20, 


12 


21, 20, 14 


22, 21, 


16 




21 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


21, 20, 


12 


22, 21, 14 


23, 22, 


16 




22 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


22, 20, 


12 


23, 22, 14 


24, 23, 


16 




23 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


23, 20, 


12 


24, 23, 14 


25, 24, 


16 




24 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


24, 20, 


12 


25, 24, 14 


26, 25, 


16 




25 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


25, 20, 


12 


26, 25, 14 


26, 25, 


16 




26 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


26, 20, 


12 


27, 26, 14 


27, 26, 


16 




27 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


27, 20, 


12 


27, 26, 14 


28, 27, 


16 




28 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


28, 20, 


12 


28, 26, 14 


29, 28, 


16 




29 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


29, 20, 


12 


29, 26, 14 


30, 29, 


16 




30 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


30, 20, 


12 


30, 26, 14 


31, 30, 


16 




31 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


30, 20, 


12 


31, 26, 14 


32, 31, 


16 




32 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


30, 20, 


12 


32, 26, 14 


33, 32, 


16 




33 


9, 


6, 6 


14 


10, 


8 


21, 


15, 


10 


30, 20, 


12 


33, 26, 14 


34, 33, 


16 



Remark 6.15. Most of the improved left-most values in Table also follow 
from Theorems \1.16\ \1. 18\WAy[ ( Concerning the latter, if the CPD of an I x I x I 
tensor of rank R is generically unique for R < k{I), then a forteriori the CPD of 
a rank-R I x I x K tensor with K > I is generically unique for R < k{I).) An 
important difference is that our bounds remain valid for many constrained CPDs. We 
briefly give two examples. Rather than going into details, let us suffice by mentioning 
that (generic) uniqueness in these examples may be defined and studied in the same 
way as it was done in Subsections \6.1\ and \6.2\ for unsymmetric CPD and SFS-CPD, 
respectively. 

1. Let the third factor matrix of I x I x K tensor T belong to a class of structured 
matrices .such that the condition I + kc > R + 2 is valid for generic C G 
n. An example of a class for which this may be true, is the class of K x 
R Hankel matrices. In Subsection \6.1\ Proposition \6.5\ leads to Proposition 
\1.31\ for unconstrained CPD. Similarly, Provosition \6.5\ with condition (|6.ip 
replaced by condition I + kc > i? + 2 leads to an analogue of Proposition 
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\1.S1\ that guarantees that a CPD with the third factor matrix belonging to Q 
is generically unique for R bounded by the values in Table lK^ (left values for 
unconstrained first and second factor matrices, and middle values in the case 
of partial symmetry). 
2. Let us now assume that the third factor matrix is unstructured and that the 
first two matrices have Toeplitz structure. Random Toeplitz matrices also 
yield the values in Table lKM Hence, such a constrained CPD is again gener- 
ically unique for R bounded by the values in Table 1 6. 2[ 
Remark 6.16. In the case rc = R, both (C2) and (U2) are sufficient for overall 
CPD uniqueness, see (|1.9|) . In the case of (C2), we generically have condition 
The more relaxed generic condition derived from (U2) is given in Theorem ll. 18i For 
the case rc < R we have obtained the deterministic result in Corollarv \1.25\ and its its 
generic version Provosition \1.3i[ both based on condition (Cm). This suggests that by 
starting from Corollaru \1.23[ based on (Um), more relaxed generic uniqueness results 
may be obtained. 

On the other hand, in Examvle \3.5\ we have studied CPD of a rank-10 (7x7x7) 
tensor. Simulations along the lines of Examvle \3.5\ suggest that condition (Ws) holds 
for random factor matrices, which then implies generic overall CPD uniqueness for 
R = 10. Starting from (C5) we have only demonstrated generic uniqueness up to 
R = 9, see the entry for I — K — 7 in Table [KM This suggests that by starting from 
Provosition \1.2B. based on (Wm), further relaxed generic uniqueness results may be 
obtained. 

7. Conclusion. Using results obtained in Part 1 [7| , we have obtained new con- 
ditions guaranteeing uniqueness of a CPD. In the framework of the new uniqueness 
theorems, Kruskal's theorem and the existing uniqueness theorems for the case R — rc 
are special cases. We have derived both deterministic and generic conditions. 

The results can be easily adapted to the case of PDs in which one or several factor 
matrices are equal, such as INDSCAL. In the deterministic conditions the equalities 
can simply be substituted. In the generic setting one checks the same rank constraints 
as in the unconstrained case for a random example. The difference is that there are 
fewer independent entries to draw randomly. This may decrease the value of R up to 
which uniqueness is guaranteed. However, the procedure for determining this maximal 
value is completely analogous. The same holds true for PDs in which one or several 
factor matrices have structure (Toeplitz, Hankel, Vandermonde, etc.). 
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